Does 'summative' count? The influence of the awarding of study credits on feedback use and test-taking motivation in medical progress testing.

Despite the increasing implementation of formative assessment in medical education, its' effect on learning behaviour remains questionable. This effect may depend on how students value formative, and summative assessments differently. Informed by Expectancy Value Theory, we compared test preparation, feedback use, and test-taking motivation of medical students who either took a purely formative progress test (formative PT-group) or a progress test that yielded study credits (summative PT-group). In a mixed-methods study design, we triangulated quantitative questionnaire data (n = 264), logging data of an online PT feedback system (n = 618), and qualitative interview data (n = 21) to compare feedback use, and test-taking motivation between the formative PT-group (n = 316), and the summative PT-group (n = 302). Self-reported, and actual feedback consultation was higher in the summative PT-group. Test preparation, and active feedback use were relatively low and similar in both groups. Both quantitative, and qualitative results showed that the motivation to prepare and consult feedback relates to how students value the assessment. In the interview data, a link could be made with goal orientation theory, as performance-oriented students perceived the formative PT as not important due to the lack of study credits. This led to low test-taking effort, and feedback consultation after the formative PT. In contrast, learning-oriented students valued the formative PT, and used it for self-study or self-assessment to gain feedback. Our results indicate that most students are less motivated to put effort in the test, and use feedback when there are no direct consequences. A supportive assessment environment that emphasizes recognition of the value of formative testing is required to motivate students to use feedback for learning.

Understanding students' feedback use in medical progress testing: A qualitative interview study.

BACKGROUND: Active engagement with feedback is crucial for feedback to be effective and improve students' learning and achievement. Medical students are provided feedback on their development in the progress test (PT), which has been implemented in various medical curricula, although its format, integration and feedback differ across institutions. Existing research on engagement with feedback in the context of PT is not sufficient to make a definitive judgement on what works and which barriers exist. Therefore, we conducted an interview study to explore students' feedback use in medical progress testing. METHODS: All Dutch medical students participate in a national, curriculum-independent PT four times a year. This mandatory test, composed of multiple-choice questions, provides students with written feedback on their scores. Furthermore, an answer key is available to review their answers. Semi-structured interviews were conducted with 21 preclinical and clinical medical students who participated in the PT. Template analysis was performed on the qualitative data using a priori themes based on previous research on feedback use. RESULTS: Template analysis revealed that students faced challenges in crucial internal psychological processes that impact feedback use, including 'awareness', 'cognizance', 'agency' and 'volition'. Factors such as stakes, available time, feedback timing and feedback presentation contributed to these difficulties, ultimately hindering feedback use. Notably, feedback engagement was higher during clinical rotations, and students were interested in the feedback when seeking insights into their performance level and career perspectives. CONCLUSION: Our study enhanced the understanding of students' feedback utilisation in medical progress testing by identifying key processes and factors that impact feedback use. By recognising and addressing barriers in feedback use, we can improve both student and teacher feedback literacy, thereby transforming the PT into a more valuable learning tool.

Design and First Impressions of a Small Private Online Course in Clinical Workplace Learning: Questionnaire and Interview Study.

BACKGROUND: Clinical workplace learning takes place in a dynamic and complex learning environment that is designated as a site for patient care and education. Challenges in clinical training can be overcome by implementing blended learning, as it offers flexible learning programs suitable for student-centered learning, web-based collaboration, and peer learning. OBJECTIVE: The aim of this study is to evaluate the Small Private Online Course (SPOC) by interns' first impressions and satisfaction measures (N=20) on using the SPOC. This study describes the design process of a SPOC from a theoretical and practical perspective and how it has been integrated into a clinical internship in internal medicine. METHODS: The design of the SPOC was based on general theoretical principles that learning should be constructive, contextual, collaborative, and self-regulated, and the self-determination theory to stimulate intrinsic motivation. Interns' impressions and level of satisfaction were evaluated with a web-based questionnaire and group interview. RESULTS: Interns thought the web-based learning environment to be a useful and accessible alternative to improve knowledge and skills. Peer learning and web-based collaboration through peer interaction was perceived as less effective, as student feedback was felt inferior to teacher feedback. The interns would prefer more flexibility within the course, which could improve self-regulated learning and autonomy. CONCLUSIONS: The evaluation shows that the SPOC is a useful and accessible addition to the clinical learning environment, providing an alternative opportunity to improve knowledge and skills. Further research is needed to improve web-based collaboration and interaction in our course.

The importance of motivation in selecting undergraduate medical students for extracurricular research programmes.

INTRODUCTION: Extracurricular research programmes (ERPs) may contribute to reducing the current shortage in physician-scientists, but usually select students based on grades only. The question arises if students should be selected based on their motivation, regardless of their previous academic performance. Focusing on grades and lacking to take motivation into account when selecting students for ERPs might exclude an important target group when aiming to cultivate future physician-scientists. Therefore, this study compared ERP students with lower and higher previous academic performance on subsequent academic performance, ERP performance, and motivational factors. METHODS: Prospective cohort study with undergraduate medical students who filled in a yearly questionnaire on motivational factors. Two student groups participating in an ERP were compared: students with first-year grade point average (GPA) ≥7 versus <7 on a 10-point grading scale. Linear and logistic regressions analyses were used to compare groups on subsequent academic performance (i.e. third-year GPA, in-time bachelor completion), ERP performance (i.e. drop-out, number of credits), and motivational factors (i.e. intrinsic motivation for research, research self-efficacy beliefs, perceptions of research, curiosity), while adjusting for gender and motivational factors at baseline. RESULTS: The <7 group had significantly lower third-year GPA, and significantly higher odds for ERP drop-out than the ≥7 group. However, there was no significant between-group difference on in-time bachelor completion and the <7 group was not inferior to the ≥7 group in terms of intrinsic motivation for research, perceptions of research, and curiosity. CONCLUSIONS: Since intrinsic motivation for research, perceptions of research, and curiosity are prerequisites of future research involvement, it seems beneficial to focus on motivation when selecting students for ERPS, allowing students with lower current academic performance to participate in ERPs as well.

First steps in the physician-scientist pipeline: a longitudinal study to examine the effects of an undergraduate extracurricular research programme.

OBJECTIVES: Medicine is facing a physician-scientist shortage. By offering extracurricular research programmes (ERPs), the physician-scientist training pipeline could already start in undergraduate phases of medical training. However, previous studies into the effects of ERPs are mainly retrospective and lack baseline measurements and control groups. Therefore, the current study mimics a randomised controlled trial to examine the effects of an ERP. DESIGN: Prospective cohort study with baseline measurement and comparable control group. SETTING: One cohort of 315 medical undergraduates in one Dutch University Medical Center are surveyed yearly. To examine the effects of the ERP on academic achievement and motivational factors, regression analyses were used to compare ERP students to students showing ERP-interest only, adjusted for relevant baseline scores. PARTICIPANTS: Out of the 315 students of the whole cohort, 56 participated within the ERP and are thus included. These ERP students are compared with 38 students showing ERP-interest only (ie, control group). PRIMARY OUTCOME MEASURE: Academic achievement after 2 years (ie, in-time bachelor completion, bachelor grade point average (GPA)) and motivational factors after 18 months (ie, intrinsic motivation for research, research self-efficacy, perceptions of research, curiosity). RESULTS: ERP participation is related to a higher odds of obtaining a bachelor degree in the appointed amount of time (adjusted OR=2.95, 95% CI 0.83 to 10.52). Furthermore, starting the ERP resulted in higher levels of intrinsic motivation for research, also after adjusting for gender, age, first-year GPA and motivational baseline scores (ß=0.33, 95% CI 0.04 to 0.63). No effect was found on research self-efficacy beliefs, perceptions of research and curiosity. CONCLUSIONS: Previous research suggested that intrinsic motivation is related to short-term and long-term research engagement. As our findings indicate that starting the ERP is related to increased levels of intrinsic motivation for research, ERPs for undergraduates could be seen as an important first step in the physician-scientist pipeline.

The effect of peer modelling and discussing modelled feedback principles on medical students' feedback skills: a quasi-experimental study.

BACKGROUND: Teaching is an important professional skill for physicians and providing feedback is an important part of teaching. Medical students can practice their feedback skills by giving each other peer feedback. Therefore, we developed a peer feedback training in which students observed a peer that modelled the use of good feedback principles. Students then elaborated on the modelled feedback principles through peer discussion. This combination of peer modelling and discussing the modelled feedback principles was expected to enhance emulation of the feedback principles compared to (1) only peer modelling and (2) discussing the feedback principles without previous modelling. METHODS: In a quasi-experimental study design, 141 medical students were assigned randomly to three training conditions: peer modelling plus discussion (MD), non-peer modelled example (NM) or peer modelling without discussion (M). Before and after the training, they commented on papers written by peers. These comments served as a pre- and a post-measure of peer feedback. The comments were coded into different functions and aspects of the peer feedback. Non-parametrical Kruskall-Wallis tests were used to check for pre- and post-measure between-group differences in the functions and aspects. RESULTS: Before the training, there were no significant between-group differences in feedback functions and aspects. After the training, the MD-condition gave significantly more positive peer feedback than the NM-condition. However, no other functions or aspects were significantly different between the three conditions, mainly because the within-group interquartile ranges were large. CONCLUSIONS: The large interquartile ranges suggest that students differed substantially in the effort placed into giving peer feedback. Therefore, additional incentives may be needed to motivate students to give good feedback. Teachers could emphasise the utility value of peer feedback as an important professional skill and the importance of academic altruism and professional accountability in the peer feedback process. Such incentives may convince more students to put more effort into giving peer feedback.

Academic Success Experiences: Promoting Research Motivation andSelf-Efficacy Beliefs among Medical Students.

THEORY: Medicine is facing a physician-scientist shortage. Medical training could contribute to developing physician-scientists by stimulating student research involvement, as previous studies showed this is related to research involvement in professional practice. Motivation for research and research self-efficacy beliefs are related to student research involvement. Based on social cognitive theory, success experiences in doing research may enhance research motivation and self-efficacy beliefs. However, the role and type of success experiences in promoting research self-efficacy beliefs and motivation especially early in medical training has not yet been investigated. Therefore, we examined if academic success experiences within an undergraduate course in academic and scientific skills increased research motivation and self-efficacy beliefs among medical students. Furthermore, type of success experience was taken into account by looking at the effects of academic success experiences within standard (i.e., exam) versus authentic (i.e., research report and oral presentation) assessments. HYPOTHESES: It was hypothesized that academic success experiences increase intrinsic motivation for research and self-efficacy beliefs. Furthermore, we hypothesized that authentic assessments influence intrinsic motivation for research and self-efficacy beliefs to a larger degree than standard assessments, as the authentic assessments mirror real-world practices of researchers. METHOD: First-year undergraduate medicine students followed a course in academic and scientific skills in which they conducted research individually. Their academic success experiences were operationalized as their grades on two authentic research assessments (written report and oral presentation) and one less authentic assessment (written exam). We surveyed students before the course when entering medical school (i.e., baseline measure) and 1 year after the course in their 2nd year (i.e., postmeasure). Both the baseline and postmeasure surveys measured intrinsic motivation for research, extrinsic motivation for research, and research self-efficacy beliefs. Linear regression analyses were used to examine the relationship between academic success experiences and intrinsic motivation for research, extrinsic motivation for research, and research self-efficacy beliefs on the postmeasure. We adjusted for prior research motivation and self-efficacy beliefs at baseline. Therefore, this adjusted effect can be interpreted as an increase or decrease in motivation. In addition, we adjusted for age, gender, and grade point average (GPA) of the first 4 months, as these variables were seen as possible confounders. RESULTS: In total, 243 of 275 students participated (88.4%). Academic success experiences in writing and presenting research were related to a significant increase in intrinsic motivation for research. After adjusting for prior GPA, only the effect of presenting remained. Experiencing success in presenting enhanced research self-efficacy beliefs, also after adjusting for prior GPA. Higher grades on the exam did not affect intrinsic motivation for research or research self-efficacy significantly. Also, none of the success experiences influenced extrinsic motivation for research. CONCLUSIONS: Academic success experiences on authentic research tasks, especially presenting research, may be a good way to enhance intrinsic motivation for research and research self-efficacy beliefs. In turn, research motivation and self-efficacy beliefs promote research involvement, which is a first step in the physician-scientist pipeline. Furthermore, this study established the applicability of the social cognitive theory in a research context within the medical domain.

Development of a Clinical Teaching Unit in Internal Medicine to Promote Interprofessional and Multidisciplinary Learning: A Practical Intervention.

Problem: Effective clinical workplace learning depends on interprofessional and multidisciplinary learning. However, traditional patient wards are centered around patient care and not so much around education. Other barriers such as time constraints also contribute to suboptimal interprofessional and multidisciplinary learning. Intervention: Six formal and informal learning activities that aimed at stimulation of interprofessional and multidisciplinary learning were designed and introduced in our patient ward to enable optimal integration of clinical practice and learning. Context: The study took place in an internal medicine inpatient ward where daily patient care is performed by specialized teams consisting of different healthcare professionals from the departments of Endocrinology, Nephrology, and Infectious Diseases. In the traditional ward setting, interprofessional and multidisciplinary learning mostly takes place during shared clinical activities. In this article, we describe the development and implementation of a Clinical Teaching Unit to support learning between different healthcare professionals. Impact: The intervention was evaluated with an online questionnaire among 108 nurses, student nurses, clerks, residents, supervising clinicians, and managers. Open-ended questions (response rate 65%) were used to determine the changes in the workplace experienced by the participants since the introduction of the Clinical Teaching Unit and what influenced their learning process and motivation to learn. Closed questions (response rate 46%) aimed to measure the effect of our intervention on collaboration, learning, and the quality of care and education. The results of the open-ended questions showed that participants experienced more interprofessional collaboration and learning. This took place in a less hierarchical, safer work climate which also resulted in perceptions of a better quality of patient care and education. The closed-ended questions showed that the intervention resulted in perceptions of improved collaboration, work culture, quality of care, education, and learning conditions. Lessons Learned: The findings imply that implementation of a Clinical Teaching Unit not only facilitates the integration of patient care and education but also the integration of different professions working together. From the intervention, we also learned that a successful Clinical Teaching Unit requires investment of time and staff, clear communication between healthcare professionals, and dedication of teachers within all professions.

Twelve tips to offer a short authentic and experiential individual research opportunity to a large group of undergraduate students.

Engaging students in research during medical school could contribute to creating an academic attitude among students, which underlies practicing evidence-based medicine in future professional practice. However, attempts to involve undergraduate students in research during medical training remain inadequate. Most medical schools educate large numbers of students at the same time, especially in early phases of medical training. Large scale education on the one hand and individually providing students with authentic research experiences on the other hand is considered not that easy to achieve. Drawing on our own experiences, existing literature and theories we propose twelve tips to design and implement a course in which authentic individual research experiences can be provided to a large group of undergraduate students.

Promoting positive perceptions of and motivation for research among undergraduate medical students to stimulate future research involvement: a grounded theory study.

BACKGROUND: Research is of great value to make advancements within the medical field and, ultimately, offer the best possible patient care. Physician-scientists are key in contributing to the development of medicine, as they can bridge the gap between research and practice. However, medicine currently faces a physician-scientist shortage. A possible solution to cultivate physician-scientists is to engage medical students in research in early phases of medical school. Evidence-based strategies to stimulate positive perceptions of and motivation for research among students could help to enhance research engagement. Consequently, understanding of students' perceptions of and motivation for research is needed. Therefore, this study aimed to identify conditions under which students develop positive perceptions of and motivation for research by answering the following sub-questions: 1) how do first-year medical students perceive research? and 2) which factors contribute to motivation or demotivation for conducting research? METHODS: We conducted a qualitative study with individual interviews using a grounded theory approach, involving 13 purposively sampled first-year medical students at Leiden University Medical Center. RESULTS: Our results suggest that first-year students are already able to identify many aspects of research. Students elaborated on the relevance of research for professional practice and personal development. Furthermore, our results suggest a relationship between perceptions of and motivation for research. Some perceptions were identical to motivating or demotivating factors to conduct research, like the relevance of research for practice and performing statistics respectively. Other motivating factors were, among others, acknowledgment, autonomy, and inspiring role models. Demotivating factors were, among others, lack of autonomy and relevance, and inadequate collaboration. CONCLUSIONS: Our results contribute to the idea that perceptions of research are related to motivation for research, which offers possibilities for interventions to promote motivation for research by making use of student perceptions of research. Consequently, practical implications to stimulate research engagement in early phases of medical school are provided. Moreover, the results contribute to existing motivational theories like Theory of Planned Behavior and Self-Determination Theory within this specific domain.

Fostering the physician-scientist workforce: a prospective cohort study to investigate the effect of undergraduate medical students' motivation for research on actual research involvement.

OBJECTIVES: The medical field is facing a physician-scientist shortage. Medical schools could contribute to developing physician-scientists by stimulating student involvement in research. Studies have examined motivation for research as a key parameter of success. However, previous studies did not investigate if students act on their self-reported motivation. The aim of this study is to examine if motivation for research of medical students is related to actual research involvement. Furthermore, this study distinguishes intrinsic (IM) and extrinsic motivation (EM) for research and aims to investigate if a type of motivation matters in the relation between research motivation and involvement. DESIGN AND SETTING: Prospective cohort study in which students were surveyed at the start of medical school and reported IM and EM for research, self-efficacy, perceptions of research and curiosity on a 7-point Likert scale. One year later, students involved in research were identified. Logistic regression was used to examine influences of IM and EM on research involvement. PARTICIPANTS: All undergraduate medical students starting at one medical school in the Netherlands in 2016. In total, 315 out of 316 students participated (99.7%), of whom 55 became involved in research (17.5%). MAIN OUTCOME MEASURE: Research involvement, which was operationalised as the enrolment of students in the research-based honours programme or the involvement of students in voluntary research activities outside of the regular curriculum. RESULTS: Students with higher levels of IM were more often involved in research (OR 3.4; 95% CI 2.08 to 5.61), also after adjusting for gender, age, extracurricular high school activities, self-efficacy, perceptions and curiosity (OR 2.5; 95% CI 1.35 to 4.78). Higher levels of EM increased the odds of research involvement (OR 1.4; 95% CI 0.96 to 2.11). However, the effect of EM disappeared after adjusting for the above-mentioned factors (OR 1.05; 95% CI 0.67 to 1.63). Furthermore, the effect of IM remained after adjusting for EM, whereas the effect of EM disappeared after adjusting for IM. CONCLUSIONS: Our findings suggest that the type of motivation matters and IM influences research involvement. Therefore, IM could be targeted to stimulate research involvement and could be seen as the first step towards success in fostering the physician-scientist workforce.

Peer instruction improves comprehension and transfer of physiological concepts: a randomized comparison with self-explanation.

Comprehension of physiology is essential for development of clinical reasoning. However, medical students often struggle to understand physiological concepts. Interactive learning through Peer instruction (PI) is known to stimulate students' comprehension, but its relative efficacy and working mechanisms remain to be elucidated. In this study, we investigated if and how PI could optimize comprehension of physiological concepts and transfer relative to Self-explanation (SE) which is considered a lower-order type of overt learning. First-year medical students (n = 317) were randomly assigned to either PI or SE in a pre-post test design, followed by a set of near and far transfer questions. In both PI and SE groups post-test scores were significantly improved (p < 0.0001) with PI outperforming SE (+ 35% vs. + 23%, p = 0.006). Interestingly, a substantial number of students with initial incorrect answers even had enhanced scores after discussion with an incorrect peer. Both methods showed higher transfer scores than control (p = 0.006), with a tendency for higher near transfer scores for PI. These findings support PI as a valuable method to enhance comprehension of physiological concepts. Moreover, by comparing the effects of interactive PI with constructive SE we have established new insights that complement educational theories on overt learning activities.

Future physician-scientists: could we catch them young? Factors influencing intrinsic and extrinsic motivation for research among first-year medical students.

INTRODUCTION: The medical field is currently facing a physician-scientist shortage. One possible solution is to direct medical students towards a research oriented career. To do so, knowledge is needed on how to motivate medical students to do research. Therefore, this study examines motivation for research and identifies factors influencing intrinsic and extrinsic motivation for research among first-year medical students. METHODS: First-year medical students were surveyed at the beginning of their bachelor's program in 2016. On a 7-point Likert scale, students reported their motivation for research, self-efficacy, perceptions of research, curiosity, and need for challenge. Regression analyses were used to examine the influence of these factors on students' motivation for research. RESULTS: Out of 316 approached students, 315 participated (99.7%). On average, students scored 5.49 on intrinsic, and 5.66 on extrinsic motivation for research. All factors measured influenced intrinsic and extrinsic motivation for research significantly and positively, also after adjusting for gender and age. Cumulative regression showed that these factors explained 39.6% of the variance in intrinsic, and 14% in extrinsic motivation for research. DISCUSSION: All factors play an important role in intrinsic and, to a lesser extent, extrinsic motivation for research. First-year medical students' motivation for research could be enhanced by stimulating positive self-efficacy beliefs, positive perceptions of research, and curiosity. Also, it is important to fulfil students' needs for challenge by stimulating them to actively conduct research. Thus, to catch students young and cultivate physician-scientists, students should be stimulated to engage in research from the beginning of medical training.

Elaboration during problem-based group discussion: effects on recall for high and low ability students.

Although elaboration has been investigated frequently, there is little evidence for the beneficial effect of elaboration in problem-based learning. A controlled experiment tested the effect of elaboration during problem-based discussion on recall. Sixty-seven students observed a video-recorded, problem-based discussion. In one experimental condition, a tutor in the video encouraged participants to elaborate by asking elaborative questions. In a second condition, the tutor asked superficial questions. After the discussion, all participants studied a text with relevant new information. Elaborative questions had no significant effect on recall of idea units from the text, p = .39, η(2) = .01. High-ability students outperformed low-ability students, p = .04, η(2) = .07, but this effect did not interact with the experimental treatment, p = .22, η(2) = .02. Suggestions for further research are presented.